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ABSTRACT 

The Program Standards Evaluation- System was developed 
in response to evaluation requirements in the 1973 Rehabilitation 
Act. The system includes procedures for using, standards data to c 
monitor and evaluate vocational rehabilitation (VR) service outcomes 
and outputs as well as standards on key' procedural issues* This 
report, which is Appendix A of the analytic paradigm ^f or ihan|gement 
use of the Program Standards Evaluation System, contains decision, 
txees and displays for the data elements of the revised performance 
standards* The report is organized as follows: (1) decision trees are 
summarized in table format, indicating several possibly explanatory 
scenarios 'for problematic performance on the data element; and (2) 
displays are keyed to each table, providing interpretation at various 
steps in the decision process and directing the analyst to the data 
elements. Most displays include a summary of the 1 problem as defined 
by the Relevant stage of investigation, including tests to use and 
norms for each data item. The tables, one for each element, show how 
the problem flagged by a particular element can be broken down into - 
more .specif ic subproklems by looking at pther data items; table 
number/6 correspond to the number of the data element in the standards 
system, and each table includes two. or more possible Scenarios that 
might explain problematic performance on the data element. Other 
displays show the logical steps summarized in the tables in more 
detail, introduce tests on other data elements, and compare the * 
values of these elements with agency norms to analyze the display 
problem. In addition to the data-element-related tables, two special 
displays describe particular situations. (KC) 
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THE REHABILITATION EXECUTIVE'S 

EVALUATION SYSTEM (TREES) - 



INTRODUCTION 



This report contains decision trees and displays for the data 
elements of the revised performance standards. Decision: trees are sum- 
marized in table format, indicating several possible explanatory scenarios 
for problematic performance on the data element. Each scenario is then 
traced through one, two, or three levels of further exploration to identify 
courses of corrective action for an agency to undertake in improving per- 
formance. Displays are keyed to each table; the displays provide inter- 
pretation at various steps in the decision process, and direct the analysy 
to the data elements, which should be used in juxtaposition to diagnose 
agency conditions. Most displays include a summary of the problem as de- 
fined by the" relevant /tage of investigation, include tests to use in 
exploring the problem, and allbw for the entry of norms (performance levels) 
for each data item as well as^ the current agency measure. The displays 
-typically either summarize the conclusions, or direct the analyst to other 
displays for further investigation. 

The tables , 'one for each element, show how the problem* flagged by a 
particular element can be broken down into more specific subproblems by 
looking at other data items (first-, second-, and sometimes third-level 
indicators). The table numbers correspond to the number of the data element 
in the standards system. Thus, Table 2ii refers to the second data element 
(ii) of Performance Standard 2. Each table includes two or more possible 
scenarios which might exjslain problematic performance on the data element. 
These "scenarios" can be followed from the left side of the table to the 
right. As jve move from left to right, additional '"indicators 11 are intro- , 
duced, to further analyze the problem and identify program implications. 
Sometimes there are references (in boxes) to particular displays in this 
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The displays show the logical steps summarized in the tables in more 
detail. The display numbering system has 'three numbers separated by periods* 
(e.g., 4.^.1) and related to the standards, the data elements, and the logic 
sequence in the tables. The first number refers to t^he standard number; 
the second refers to^he data element. The third number refers to the 
display f s position in the table's logic system. An "0" indicates that 
- the ^display relates to the ovetall problem flagged by the data element. 
The numbers 1,2,... indicate the order that the secondary problems 
occur in the table. The numbering system is important, because the analyst 
may be referred to a particular display from a tabl^ or from another display. 

The displays summarize the program problem indicated the data element 
(primary problem) or by the data element in combination with other data 
(secondary problems). In most displays, tests on other data elements are 
introduced. The values of these elements are compared with agency norms 
or standards, to analyze the display problem. "Yes" or "no 11 responses to 
questions based on the comparisons of values to norms lead the ^analyst to 
more detailed interpretation of the agency problem, and to further tests ^ 
or, wi£h a statement like "go to Display 1.1.4, w to the next displays in 
the analysis sequence. If the user is referred to further tests, the * 
relevant values aiyi norms' are again defined in the display. If, instead, 
a "go to.r. M statement refers to a new display, the problem statement in 
Che referenced display pill be more detailed. The displays sometimes call 
for manager judgment, in addition to the kind of numerical comparison in 
the tests. The judgments ajbe identified by Query . ^ 

In addition to the data-element -related tables and displays, there 
are two special displays. Display 10,1.0 includes a number of variables 
that might be used in an analysis of client data to explore a problem which 
cannot be pinpointed entirely through the logic system. Thh data can be 
used in bivariate or multivariate analysis of the program. Displiy 10.2.0, 
and the accompanying flow diagram, concerns agency time-in-status and case ^ 
timeliness analysis. If case time in status or'timeliness is. indicated on 
the agency's performance problem, this dismay suggests an investigation 
approach. K 

The logical system presented here shows how the data items in the stan- 
dards can be used to explore program relationships. Other data items could 

\ 
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be usted lijce this as well,,ito build other logical "trees. 11 As with any pro-* 
gram analysis techniques, the exploratory method presented in the decision 
trees and displays should be used in combination with common sense about 
program operations. The data elements are intended to alert managers to 
deviation from rehabilitation go^ls. 

State agency data should be used to* analyze the frequency of the sug- 
gested ^scenarios and branches; Some of these may occur only rarely in a 
particular "agency; others may account for most of the problems in performance. 
The most frequent branches should be further articulated and refined in the 
context of individual agency ,situat ions. ^ 
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LIST OF TABLES AND DISPLAYS 

1 \ 



SPECIFIC DATA ELEMENTS 

Table l(i): Standard One, Data Element One 
' Problem: Clients per 100,000 State Population is Too Low 

Display 1.1.0 : Primary Problem: The number of units per 
100,000 populati^i is too low. 

Display 1.1.1 ; Secondary Problem: The agenc^s # of clients 
per 100,000 state population is too low, and the current 
total caseload is too small. 

Display 1.1.2 : .Secondary Problem: The agency's # of clients 
per 100,000 state population is too low; the current caseload 
I is sufficient, but the agency is not bringing inf. enough new 

clients. Action is needed to increase acceptances. 

^ Display 1.1.3 : Secondary Problem: The agency/s # of clients 

' ' p-er 100,000 state population is too low; the' agency served a 

sufficient number of clients but had too few closures relative 
, to acceptances. 

Display 1.1.4 : Secondary Problem: The agency's #' of clients 
*\ . .per 100,000 stat!e population is too low; the agency served a 

j sufficient total caseload but there were, too few closures' and 

too few additional clients. Investigation and action' is needed 
on both closure and 11 acceptance' rates. 
. Display 1.1.5 : Secondary Problem: ^ The agency's # of clients 
per 100,000 s*ate population is' too low. The total agency 
caseload is 'too small. Within the context* of the current total 
caseload, client flow^is acceptable.' But, given the small size 
of the total caseload: 
i 1. Take action to increase acceptance rate^ 

. •' 2. Monitor closure rate. 

Display 1.1.6 : Secondary Problem: The agency 's.# of clients 
per 100,£00 rfcate population is too low. The total agency case 
load is too small and closure rate is low. Speed closure rate 
in conjunction with efforts to increase acceptance. 

-ERIC , • - . . . t)0 *< 7 
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Display 1.1.7 : Secondary^ Problem: The agency's # of clients . 
per 100,000 state population is too low. The total agency 
caseload is too low. Closure rate is adequate relative to , 
v total caseload but, relative to an already insufficient case- 
load, too new new clients are being admitted. Take action to 
increase acceptance. * . 0 

t jjjfrsp lays 1,1,8 : Secondary Problem: The agency's # of clients 

per 100J000 state population is too low. .The total agency case- 
load is too small. The agency closure rate is $00 low and 
acceptance rate is low. 

T able l(ii) : Standard One ✓'Data Element Two 

Problenj: The Percentage of Caseload That is Severely Disabled 
is Too Low ^ 

Display 1.2.0 :,, Primary Problem: The percentage of the caseload 
• that is severely disabled is too low. 

Display 1.2.1 : Secondary Problem: The percentage of the case- 
load that is severel disabled is too low, but the numbdf " of SD 

j 

clients meets agency standards, and the rehabilitation rate of 
these clients is adequate. 

Display 1.2.2 : Secondary Problem: The percentage of the 
caseload that i£ severely disabled is too low, the n umber 
of SD clients meets agency standards, but their rehabilitation 
rate Is too low. 

Display 1.2.3 : Secondary Problem: The percentage of the case- 
load that is ^eve^ely disabled is. toQ low, and # the dumber of 
SD clients is too low; those clients do, however, have 'a success 

s * 

rate that is adequate. 

Display 1.2.4 : Secondary Problem: The percentage of the case- 
load that is severely disabled is too low and the number of 
SD clients is too low. The rehabilitation rate for SD clients 
ife too low. „ > f 



ERIC 



8 



Table '2(i) : Standard Two, % Data Element One^ 

Problem^ Expenditures per Competitively Employed Retiabili- 
tant Too High , 

Display 2,1,0 : Primary Problem: Expenditures. per competitively 
employed, rehabilijbant are too hi|jh. % 

Table 2(ii) : Standard" Two, Data Element One 

Problem:* Expenditures Per Rehabilitation Are Too High 



A 



Display 2,2.0 : Primary Problem: Expenditures per rehabilita- 
tion are too high. 

^ Display 2.2.1 : Secondary Problem: Expenditures per rehabili- 
tation are too high, Expenditures per closure and per case 
are acceptable. 

Display 2,2.2 : Secondary Problem: Expenditures per rehabili- 
♦ tation and per closure are too high. Expenditures per case 
are acceptable. 

Display 2,2,5 : Secondary Problem* Expenditures per rehabili- 
tation and per case are too high. Expenditures per closure 
are acceptable, / 

Table 2Ciii) 

and/or 2(iv) : Standard" Two, Data Elements ^J*l^e and/or Four 

. Problem: The Ratio of Benefits to Costs (B/C) pr the Nets 

Benefit (B-C) or Both are Too Low 

Display 2,3,0 and 2,4,0 : Primary Problem: The ratio of 
. benefits to % cost| or the net benefit-, or both, are too low, 

# 

Table 3(i) : Standard Three; Data Element One 

Problem: Percentage of Rehabilitation is Too Low* 

Display '3.1,0 : Primary Problem: Percentage of rehabilita- 
tions (% 26) is too low. 
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Display 3 . 1 A : Secondary Problem:- Percentage of rehabili- 
tations is too low, and so is the percentage of competitively 
closed 26s. , However, .th§ overall number of rehabilitations 
is at an acceptable levelj 

Display 3.1,2 ; Secondary" Problem: The number and percentage 
of rehabilitations is too low, as is the percentage of / 
rehabilitants closed competitively. This agency 1 ^ overall , k 
Rehabilitation rate is too low* 

Display 3.1.3 : Secondary- Problem: The number and percentage , 
of rehabilitations are both too low; however, the percentage 
of rehabilitants competitively employed is acceptable. Agency 
priority ^s on competitive employment- and fewer clients are 
served. 

Table 3(ii) : Standard Three, Data Element Two 



Problem: There is a Problem in the Annual Change in 
Rehabilitations 

Display 3.2.0 : Primary Problem: • . The annual change in re- 
habilitations is not adequate*. 

I 

Table 4(i) 

and 5(ii) : Standard Four, Data., Element* One and Standard Five, Data 
Element Two 

Problem: hj 26s Earning Weekly Minimum Wage is Too Low and/or 
/ <. % Competitively Employed 26s Earning Hourly Minimum Itfage is 

Too Low # 

Display 4.1.0 : Primary Problem: % 26s earning weekly minimum 
wage is^too low. 

* • Display 4.1.1 : Secondary Problem: % 26s earning weekly 

* V 

minimum wage is too low, but both the % of competitively 

J: / % 

employed Rehabilitants earning the minimum wage «and the % 

' bf competitively employed rehabilitants are acceptable. 
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Display 4.1.2 : .Secondary Problem: % 26s earning weekly 
minimum wage is too low, as is the % competitively employed 
26s with hourly earnings above the minimum wage* However, 
the % of rehabilitants competitively employed is acceptable ♦ 

* Display 4.1.3 : Secpndary Problem: % 26s earning the weekly . 
minimum wage as too low,, but the % compfcti/tively employed 26s 
with hourly earnings above the minimum wage is acceptable. 
/This agency generates too few OE closures, thus reducing*^ 

„ ' earnings for all 26s. 

* Display 4.1.4 : Secondary Problem: % 26s earning weekly minimum 
wage is too low, the % of competitively employed rehabilitants 
with hourly earnings above minimum wage is too low, and the % 
of competitively employed 26s is too low for the agency. 

Table 4(ii) : Standard Four, Data Element Two 

Problem: Average Earnings of Competitively Employed Rehabilitants 
Are Too Low When Compared to Average Earnings of Employees in 
State m ■ 

Display 4.2.0 : Primary Problem: Average earnings of competitively 
employed rehabilitants are too low when compared to average 
earnings of employees in state. i 

Display 4.2.1 : Secondary Problem: The average earnings of 
competitively employed rehabilitants is too low when compared 
to average earnings of employees in the state ,f However, the 
relationship of median earnings for the 'two groups is acceptable. , 

Display 4.2.2 : Secondary Problem: -Both the average and median 
earnings of competitively employed rehabilitants are too low / 
when compared to "the average and median earnings, respectively, 
% . of employees in the state. 

Table 5,(i) : Standard Five, Data Element One 

r Problem: Percentage of Competitively Employed Rehabilitants 

is Too Low • % 
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Display 5.1.0 : Primary Problem: Percentage of competitively 
employed reha&ilitants is too lovj. 

Display)s.l.l : Secondary* Problem: Percent age % of competitively 
employed rehabilitants ,is too low. C-E goal/occupation corres- 
pondence ratio is too low and % N-C-E plans is too high. 

Display 5.1.2 : Secondary Problem: Percentage , of competitively 
employed rehabilitants is tod low. C-E goal/occupation corres- 
pondence is acceptable, but %' N-C-E plans is too high. 

Display 5.1.3 : Secondary Problem: Percentage of competitively 
employed rehabilitants is too low but*. C-E goal/occupation corres- 
pondence and % N-C-E plans are acceptable. 

Display 5.1.4 : Secondary Problem: Percentage of competitively 
employed rehabilitants is too* low. C-E goal/occupation corres- 
pondence is too low but % N-C-E plans is acceptable. 

T abl^ 6(i) : Standard Six, Data Element One 

. Problem: Client Earning Gain is Insufficient 

Display 6.1.0 : Primary Problem: Client earning gain is, insu- 
f- 
ficient. 

Table 7(i) :\ Standard Seven, Data Eleirfent One 

Problem: There is a High Percentage of Clients Employed at 
Closure Who Have Not Retained Their Earnings at Follow-up 

Display 7.1.0 : Primary Problem: A high pe.rcentage of clients 
employed at closure have not retained' their earnings at follow- 
up. 
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GENERAL 'CLIENT AND SERVICE ANALYSES '* .. / * 

Display 10.1.6' : PToblem: Displays indicate need for ana.lysi's 

;. V . of agency client and service problems. Da^a'^fTes on variables 

* such as the : following sfrould be used" for statistical ^analysis--. 

of services* * v ^ • ^ * 

^ - ^ 

' • • . ' • * 

ANALYSIS OF TINE -IN- STATUS PROBLEMS \ 4 



Display 10.2..0 : * Select sample, of active cases, Compar^ times- 
in status with agency norms. 
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Table 
Standard One 



erit One 



Problem: I Clients Per 100,000 State population is Too Low 



Scenario 
■ ■ 1 w* 


„ V 

First Level Indicators 


* : ■ — i 

Second Level Indicators 


Third Level Indicators 


/ 

L * Served 


Implications \ 


1 Closed 
I. Served 


1 Accepted 
1 Served 


Implications 


i - 



t 



caseload at. present. Examine 
caseload data to determine 
longer rurv caseload picture. 



Acceptable Too low 



The agency -is not bringing in 
gm enough clients. Take action to 
jj increase acceptances. 



I applicants; 02 arvoV 06 data 



Po to |1 .1.21 
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Too low 

I 



-Acceptable 



Too low 



Too low 



The agency served sufficient nun- Go tto |l . 1 . 3| 
bers of clients, but had too few *• 
closures. Take action to in- 
_cre£se £l£sure (r rate[ 1 * 

The agency had a .sufficient .total Op t<r |1.1.4| 
caseload, but too few closures 
and too few additional cliqn£s. 
Investigation and action needed 
on both closure rate* and accep- 
tance rate. • 



Too low * The agency's total caseload is 

too small. Increase the rate for 
. accepting new clients. Check 
^ caseload data-. 



Acceptable Acceptable 



Too low 



\ 
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Too low 



Acceptable 



Acceptable Too low 



Too low 



' ? * , » 

Within the context of current Go to |1.1.5| 

total caseload tfize, client flow ' ' 
is acceptable. But, given thp 1 
small size of the total caseload: * - 

(1) take action to increase ac- 
ceptance rate, and (2) monitor 

_future £l£sure rate^ , _ _ _ 

The ageo*? may already- have prob- Go to |1 .1 .61 « 
lems processing and closing 
clients. Speed the rate of clos- 
ures, in conjunction with efforts 
_t£ im£r£ve ac£e£t an£e^ _ _ _ _ 

Relative to an already insuffic- Go to |1.1.7| 
lent total caseload, too few 
clients are being admitted. Take 
_a£t h)n £o_incjnease a_cce£tance_v _ _ _ 

Increase number of acceptances Go to [1 . 1 .8| 
and speed case flow. 



> 
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DISPLAY 1.1.0 



PRIMARY PROBLEM: THE NUMBER OF CLIENTS PER 100,000 POPULATION IS TOO LOW 

(REFER TO TABLE l(i)) ^ 

TEST; # CLIENTS SERVED (STATUSES J. 0- 30) ' (FIRST* LEVEL INDICATOR)" 
. . XXXXX (VALUE) . _ 
XXXXX (VALUE LAST YEAR) 



^ XXXXX (PLANNED^ 

'IS VALUE ACCEPTABLE? 



YES 



NO 



IF NO, GO TO DISPLAY 1.1.1 ■ ' 

IF YES, THE 'AGENCY HAS A SUFFICIENT TOTAL CASELOAD AT PRESENT. EXAMINE 
CASELOAD DATA TO DETERMINE LONGER RUN CASELOAD PICTURE.' 



TEST: (SECOND LEVEL INDICATORS) 

A. » CLOSED (28,30) 
•# SERVED (10-30) 

(VALUE) XXXX 

(NORM) XXXX 

I 

ACCEPTABLE* YES 
NO 



# ACCEPTED (NEW 10s) 

# .SERVED (10-30) 

{VALUE) XXXX 
(NORM) ' XXXX 
ACCEPTABLE? YES 
NO 



IF YES TO' A. AND B., NO PROBLEM IS INDICATED 
IF YES TO A. AND NO TO B., GO TO DISPLAY 1.1.2 
IF NO, TO A. AND YES.TO B., GO TO DISPLAY 1.1.3 
IF NO TO BOTH A. AND B., GO TO DISPLAY 1.1.4 



A-13 



/ 



DISPLAY 1.1.1 



SECONDARY PROBLEM: THE AGENCY'S # OF CLIENTS PER 100,000 STATE POPULATION IS 

TOO LOW, AND THE CURRENT TOTAL CASELOAD IS TOO SMALL. 



TEST: (SECOND LEVEL* INDICATORS) 

A. # CLOSED (28,30) 
# SERVED (10-30) 

•(VALUE) XXXX 

(NORM) XXXX ■ 

ACEPTABLE? 

4 



YES' 
NO 



B. . EXCEPTED (NEW 10s) 
# SERVED (10-30). , 

(VALUE) XXXX 

(NORM) XXXX 

ACCEPTABLE? YES 

NO' 



S 



IF YES TO A.OAND B.., GO TO ^D*SPLAY 1.1. S ** » 
•IF NO TO A. AND YES TO B., GO TO DISPLAY 1.1.6 
ifIyes TO A.^AND NO TO B., GO 'TO DISPLAY 1.1.7 
IR.N0 TO BOTH A. AND B., GO TO DISPLAY 1.1.8 
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DISPLAY 1.1.2 » — - 

4 

SECONDARY PROBLEM: THE AGENCY'S # OF CLIENTS PER 100,00b STATE POPULATION 

IS TOO LOW; THE'" CURRENT CASELOAD IS SUFFICIENT, BUT THE 
AGENCY IS NOT BRINGING IN ENOUGH /NEW\CLIENTS . ACTION 
IS NEEDED TO INCREASE ACCEPTANCES.. ■ 

TEST: (THIRD LEVEL INDICATORS) ' * 

# APPLICANTS (# OF ON-HAND AND NEW APPLICANTS?. * 
(VALUE) XXXX ( s ' ACCEPTABLE? YES 

(NORM) XXXX 

I 



. NO 



IF NO,« IMPROVE OUTREACH. 

IF YES, TEST FOR LENGTH OF APPLICATION PROCESS TO SEE IF IT IS TOO LONG. 
AVERAGE. MONTHS IN STATUS 02: 

(VALUE) XX ACCEPTABLE? YES 

(NORM) XX . . NO 

IF NO, SPEED APPLICATION PROCESS. 

IF YES, EXAMINE USE OF 06 (EXTENDED EVALUATION^) STATUS TO DETERMINE IF IT 
IS BEING USED 1 INAPPROPRIATELY. y 



A. '* 02 ENTERING 06 . 
#~02 

(VALUE) XXXX 
(NORM) XXXX 
ACCEPTABLE? YES 
NO 



► B. ' AVERAGE MONTHS IN STATUS 06 

JALUE) XXXX 
(NORM) XXXX 
ACCEPTABLE? YES 
NO 



IF YES TO A. OR^B., ANALYZE CLIENTS IN 06. GO TO DISPLAY 10.1.0, CLIENT 
.ANALYSIS , AND 10.2.0, TIMELINESS ANALYSIS , for 06. *" 

IF NO TO A. AND B. , CHECK ELIGIBILITY DETERMINATION POLICY TO DETERMINE 
IF IT IS APPROPRIATE. - * 

18 



' DISPLAY 1.1.3 

SECONDARY PROBLEM: THE AGENCY'S # OF CLIENTS PER 100,000 STATE POPULATION IS 

• TOO LOW; THE- AGENCY SERVED A SUFFICIENT NUMBER OF CLIENTS 
BUT HAD TOO FEW CLOSURES RELATIVE TO ACCEPTANCES 

TEST: (THIRD-LEVEL INDICATORS) 

•f ) 

CHECK IF PROBLEM IS EXPLAINED BY UNUSUAL INCREASE IN ACCEPTANCES 
# NEW STATUS 10s 
(VALUE) XXXX 

• (NORM) XXXX (HISTORICAL DATA, LAST^-YEAR AVERAGE) 
UNUSUALLY HIGH? YES ^ ^ . 

. NO 

IF YES, THE LOW VALUE OF CLOSURES TO ACCEPTANCES MAY BE TEMPORARY. MONITOR 
THIS VALUE OVER^THE NEXT QUARTERS. 

IF NO, REVIEW CASES TO DETERMINE IF CLOSURES ARE IMMINENT: 



4 SO. + # 22 
10 to 24 
* ' y 

/ (MLUE) XXXX 



(NORM) XXXX 

HIGH \ ABOUT TO BE CLOSED? YES 

NO 



IF YES, CLOSURE RATE SHOULD IMPROVE. MONITOR. IF NO IMPROVEMENT, GO TO ^ 
DISPLAY 1.1.0. 

/ 

IF NO, REVIEW SAMPLE OF CASES TO DETERMINE IF CURRENT CASES HAVE RELATIVELY 
LONG TIMES IN PR8CESS. INSPECT CASES FOR: PLANNED DURATION OF SERVICE AND 
TYPES OF SERVICES PLANNED. . 



mo 



19 



A-16 



DISPLAY 1.1.4 

> ' ». 

SECONDARY PROBLEM: THE AGENCY* S # OF CLIENTS PER 100,000 STATE POPUlXrjON IS 

TOO LOW; THE AGENCY SERVED A SUFFICIENT TOTAL CASELOAD 
BUT THERE WERE TOO FEW CLOSURES AND TOO FEW ADDITIONAL 
CLIENTS.' ' INVESTIGATION AND ACTION IS NEEDED ON BOTH . 
CLOSURE AND ACCEPTANCE RATES'. 



QUERY: WOULD ACCEPTANCE RATE BE IMPROVED BY 5L0SING OUT MORE CLIENTS? 

• (MANAGER JUDGMENT) k . « ) 



YES: GO TO DISPLAY 1.1.3 

\ 

NO: GO TO DISPLAY 1.1.2 • 



il 
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A 



c 



DISPLAY l.l'.S 

•SECONDARY PROBLEM: THE AGENCYZS # OF CLIENTS PER 100,060 STATE POPULATION 
, * - IS TOO* LOW. THE TOTAL AGENCY CASELOAD IS TO'O SMALL. 

WITHIN THE CONTEXT OF THE CURRENT TOTAL CASELOAD // 
CLIENT FLOW IS ACCEPTABLE. BUT, GIVEN THE SMALL' SIZE 
" OF THE TOTAL CASELOAD: ' <- 

1. V TAKE ACTION TO INCREASE ACCEPTANCE RATE ' 

2. MONITOR CLOSURE RATE *, 

• ■ , 

QUERY: WOULD ACCEPTANCE RATE BE .IMPROVED BY QLOSING OUT MORE CLIENTS? 

(MANAGER JUDGMENT) * / 

YES: GO TO DISPLAY 1.1.3 '• ^ 

NO: GO TO DISPLAY* 1.1.2 

\ I ■ 



0 
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DISPLAY 1.1.6 



SECONDARY PROBLEM: THE AGENCY • S # OF CLIENTS PER 100,000 STATE POPULATION 

IS TOO LOW. THE TOTAL AGENCY CASELOAD IS TOO SMALL 
AND CLOSURE RATE IS LOW. SPEED CLOSURE RATE IN CON- 
JUNCTION WITH EFFORTS JO INCREASE ACCEPTANCE. 

v 

QUERY: WOULD ACCEPTANCE RATE BE IMPROVED BY CLOSING^ OUT. MORE CLIENTS? 
^MANAGER JUDGMENT) 

YES: GO TO DISPLAY 1.1.3 

NO: GO TO DISPLAY 1.1.2 




< 



22 



ERIG 



A-19 , 
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DISPLAY 1.1.7 



) 

SECONDARY PROBLEM: THE AGENCY'S # OF CLIENTS PER 100,000 STATE POPULATION 

IS TtO LOW. THE TOTAL AGENCY CASELOAD IS TOO LOW. 
CLOSURE. RATE IS ADEQUATE RELATIVE- TO TOTAL CASELOAD, 
BUT RELATIVE TO AN ALREADY INSUFFICIENT CASELOAD, TOO 



FEW. NEW CLIENTS ARE BEING ADMITTED. TAKE ACTION TO 
INCREASE ACCEPTANCES. 



/ 



GO TO'TEST, DISPLAY. 1.1.2 

/ . ■• 



r 

\ 
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D ISP-LAY l.l v .8 
v 



SECONDARY PROBLEM: THE AGENCY'S # OF. CLIENTS PER 100,000 STATE POPULATION 

IS TOO LOW. THE TOTAL AGENCY CASELOAD IS TOO SMALL. • • 
THE AGENCY CLOSURE RATE IS TOO LOW AND ACCEPTANCE RATE 
IS LOW. 



QUERY: 



YJ^C 



WOULD ACCEPTANCE RATE* BE IMPROVED BYlQLOSING OUT MORE CLIENTS? 
(MANAGER JUDGMENT). 

YES: GO TO DISPLAY 1.1.3 ' , ^ 

NO: GO TO DISPLAY 1.1.2 



t r 
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Table 

Standard One, -Dm Element Two • 
Problem: The Percentage of Caseload That Is Severely Disabled Is Too Low 







First Level Indicators 


Second 


Level Indicator 






Rehabilitation 












Hates for SDs 








Scenario 


» SDs in 
Caseload 


adequate or too 
low compared to 
Agency Rehabil- 
itation Rate? 


Implications 




Action 



1 Adequate Adequate 



A small 1 of case- 
load is severely 
disabled but they 
are serviced 
enough and being ^ 
successful; test 
for excessive 
service costs 



la 



Expenditure/ 
Closure « 
acceptable 



No problem is indicated 



lb Expenditure/ 
Closure too 1 
high 



See 



EZ3 



Examine SD cases during 
case review to determine 
if too much is spent on 
the cases 

Go to 12.2.01 



Adequate Too low 
♦ 



Examine the rate 
and timeliness 
for SD clients 



Are SD clients 
taking longer to 
serve so that 
their closures 
will be in future 
years? 



If YES, forecast closure 
dates. Establish goal for 
closure rates biased on 
this forecast. Monitor 
closure rates over time to 
Test for long-run stability 
on this element 



See |1.2.2| 



When are SD 
clients not 
succeeding? 



Examine patterns of non- 
success of SDs 



Too low Adequate 



Either an out- 
reach problem or 
an acceptance 
rate problem 



See |1.2.3| 



# 02s SD 

* closed 08 by 
reason Jf 
severity 



If I 02s SD too low, 
£eWe_w_outreach £roccidures 

If \ 08 or I 08 by reason 
of severity 
screening may be too ' 
rigorous to meet agency 
goals. Do case reviews 
to determine feasibility 
of these cases 



Too low Too low 



Same as 2 U 
See p.2.2[ - and 
fiTP| or "see fm\ 
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\ < 

DISPLAY 1.2.0 



PRIMARY PROBLEM: THE PERCENTAGE OF THE CASELOAD THAT IS SEVERELY DISABLED 
.. IS TOO LOW I . 4 

(REFER TO TABLE l(il)) 

! S 

TEST: (FIRST LEVEL INDICATORS) j 

\ ^) 

# SEVERELY DISABLED IN CASELOAD j ^ REHABILITATION RATES FOR SDs COMPAR- 
ABLE TO AGENCY. REHABILITATION RATE? 

26 SEVERELY DISABLED 

#\ (26 + 28+ 30) SEVERELY DISABLED 

(NORM). ; XXXX , - * 
('SD RATE) XXXX 

j A, ' . ' 

Bl TOO LOW COMPARED TO AGENCY RATE? 

i ■ Vj 

YES 
NO 



(NORM) XXXX 
(VALUE) XXXX 

A. TOO LOW? 
YES 
NO 



IF NO TO BOTH A. AND B., GO TO DISPLAY 1.2.1 

IF NO TO A. AND YES TO B., GO TO DISPLAY 1.2,.2 

IF YES TO A. AND NO. TO B., GO TO DISPLAY 1.2.3 

IF YES TO BOTH A. AND B., GO TO DISPLAYS 1.2.2 AND 1.2.3 
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.DISPLAY 1.2.1- 

* * 

SECONDARY PROBLEM: THE^IfeRCENTAGE OF THE CASELOAD THAT IS SEVERELY DISABLED 

IS TOO LOW, BUT THE NUMBER OF SD CLIENTS MEETS AGENCY 
STANDARDS AND THE REHABILITATION RATE OF THESE CLIENTS 
< IS ADEQUATE. 

TEST: (SECOND LEVEL INDICATORS) *' 
CHECK fF THIS REPRESEn\"S EXCESSIVE COSTS ' • 
EXPENDITURE/CLOSURE TO^ HIGH? YES * 

/ NO/ 



IP 



IF YES: * . 

A. EXAMINE SD "CASES IN CASE REVIEW TO DETERMINE IF TOO 
MUCH IS SPENT- ON THE CASES. 

B. GO TO DISPLAY 2.2^0 

IF "NO, LOW PERFORMANCE ON THIS DATA ELEMENT DOES NOT INDICATE A PROBLEM. 



♦ 
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DISPLAY 1.2.2 



SECONDARY PROBLEM: THE PERCENTAGE OF THE CASELOAD THAT IS SEVERELY DISABLED 

IS TOO LOW, THE NUMBER OF SD CLIENTS MEETS AGENCY 
STANDARDS, BUT THEIR REHABILITATION RATE IS TOO LOW. 



TEST: (SECOND LEVEL INDICATORS) 

EXAMINE THE RATE AND TIMELINESS FOR SD CLIENTS 
' TIME IN PROCESS 
(SDs) XXXX ^ 
(NORM) XXXX 

LONGER TIME FOR SERVICE? YES 

■ NO 



IF YES, FORECAST CLOSURE DATES AND ESTABLISH GOAL FOR CLOSURE RATES 
BASED ON THIS FORECAST. MONITOR CLOSURE RATES OVER TIME TO TEST 
FOR LONG-RUN STABILITY ON THIS ELEMENT. 



ANALYZE NONSUCCESSFUL SDs TO DETERMINE REASONS FOR LOWER REHABILITATION 
RATE. 
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DISPLAY 1.2.3 

9 

- * 

SECONDARY PROBLEM: THE PERCENTAGE OF THE CASELOAD THAT IS SEVERELY DISABLED 

IS TOO LOW, AND THE NUMBER OF SD CLIENTS IS TOO LOW; 
THOSE CLIENTS DO, HOWEVER, HAVE A SUCCESS RATE THAT IS 
"ADEQUATE . 



TEST: (SECOND LEVEL^ INDICATORS) 

CHECK WHETHER THE PROBLEM IS EITHER IN LOW APPLICATION OF SDs OR IN 
THE ACCEPTANCE RATE, OR BOTH 

# 02s SD 

# 02s 

(VALUE) XXXX 
(NORM). XXX^C . 
TOO LOW? YES 
NO 

IF YES, -REVIEW OUTREACH PROCEDURES TO INCREASE NUMBER OF ELIGIBLE SD 
APPLICANTS. • 

% CLOSED 08 BY REASON OF SEVERITY: 
(VALUE) XXXX 
(NORM) XXXX 
TOO HIGH? YES 
• .NO 



IF YES, DO CASE REVIEWS TO EXAMINE THE CASES CLOSED TOO SEVERE TO ASCERTAIN. 
IF CRITERIA FOR ACCEPTANCE ARE TOO LIMITED., 




ERIC 
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DISPLAY 1.2.4 



SECONDARY PROBLEM: THE PERCENTAGE OF THE CASELOAD THAT IS SEVERELY DISABLED 

IS TOO LOW AND THE NUMBER OF SD CLIENTS IS TOO LOW. 
THE REHABILITATION RATE FOR SD CLIENTS IS TOO LOW. 



GO TO TESTS ON DISPLAYS 1.2.2 AND 1.2.3 
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Table 2(i) 
Standard Two f Data Element One 
Problem: Expenditures Per Competitively Employed Rchabilitant Too High 





First Level Indicators » 


Scenario 


Expenditures 
Per 26 (2ii) 


Percent 26 - 
Closures 
Competi- 
tively, 
Empl oyed 
(5i) 


Implications 


1 


Acceptable 

•> 


Acceptable 


Hay not be an expenditure problem. 
Recheck method for setting performance 
levels for competitive' 26 (too. high?) 
or all 26s (too low?l 


2 


Acceptable 


Too low 


Before your expenditures per competi- 
tively employed 26s can be at an 
acceptable level* you must increase 
the percent of your 26 closures who 
are competitively employed 

Go to |5.1*0J / 


3 y 


Too high - 

1 


Acceptable 


Since your percent of 26 closures who/ 
are competitively employed' is accept* 
able, the problems you face with your 
expenditures per 26 are the same as 
the problems you face with this data 
element » 

Go to |2.2.0| 


4 


Too high 


Too .low 


You have both a problem in your per- 
cent 26 closures who are competitively 
employed and in your expenditures per 
26 

Go to |2.2.0| and (5.1.0) 
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DISPLAY 2.1.0 



PRIMARY PROBLEM: EXPENDITURES PER COMPETITIVELY EMPLOYED REHABILITANT * 
ARE TOO HIGH 

(REFER TO TABLE 2(i)) 



TEST: '(FIRST LEVEL INDICATORS) 
A. TOTAL EXPENDITURES/* 26 
(VALUE) XXXX 



(NORM) , XXXX 



TOO HIGH? 



YES 
NO 



B. #26 COMPETITIVELY EMPLOYED/* 26 
(VALUE) XXXX 
(NORM) XXXX 
TOO LOW? YES 
NO 



IF NO TO A. AND B., NO PROBLEM IS INDICATED. RECHECK THE AGENCY METHOD FOR 
SETTING PERFORMANCE LEVELS FOR COMPETITIVE REHABILITATIONS (TOO HIGH?) OR 

FOR ALL REHABILITATIONS (TOO LOW?) . * 

r . 

IF NO TO A. "AND YES TO B., GO TO DISPLAY 5.1.0. 
IF YES TO Al # AND NO TO B., GO TO DISPLAY 2.2.0. 
IF YES TO A. AND B., GO TO DISPLAYS 2.2.0 and 5.1.0. 
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Problem: 



Table 2(ii) 
Standard Two, Pat* Element Two 
Expenditures Per Rehabilitation Are Too Hig h 



Scenario 



First Level Indicators 



Expenditure/ 
Closure 



Expend i~ 
ture/Case 



Implica- 
tion 



1 



Second Level Indicators 



"Leading 
Questions" 



Acceptable Acceptable 



Too High 



Acceptable 



Acceptable 



ptable 



Too High 



Agency is 
achieving 
too low a 
proportion 
of 26 
closures 



Evaluation 



Standards Data 
Element 3(i) 

(£26 \ 



Is thrf % too 
low? 

If ^e^ why? 



2a 



estions 



Analysis of .successful closures 
Go to |3.1.0j 



See |2.2.I} 



If no, which 
clients or 
components 
cost too 
much? 



Service costs to: 
-- 2ps 

~ 28s and 30s 

— 08s 



What is the average life-of-case 
cost for eac^ closure group? 

What proportion of total life-of- 
case costs are spent on each 
closure group? 



Service costs by 
service type 

See (10,1,01 



Wh*t proportion of current service 
costs went to each service type? 

What is the average cost of each 
service type, for clients receiv- 
ing that service? 



Agency is 
serving 
clients 
too 

slowly: 
achieving 
too few' 
closures 



Post-Acceptance 
Closure Rate 

/ *26+l28+»30 \ 
\» open cases / 



Is the ser- 
vice process 
too slow? 



Timeliness; Statuses 
10-12/12-24 
Average time from 
acceptance to 
.closure (10-24) 



Which aspect of services/ for 
accepted clients takes /relatively 
too long? 



See [2.2.2) 



Have we had 
a recent 
influx of 
acceptances? 



Rate of accept- 
ance 



None (end of investigation) 



Agency has 
recently 
developed 
a bottle- 
neck in 
intake 
process: 
too few 
clients 
being 
accepted 
into the 
system 



Standards Data 
Element l(ii) 

/ * served (10-30) 
\ 100,000 population 



) 



Rate of acceptance 

f i of new gtatn*; \Qs 

* new applicants + 
' on-hand applicants 

♦ * on-hand 06s / 

_See |272T3) 



Do we have 
too , fen 
applicants? 

Does, use of 
Extended Eval- 
uation account 
for the low . 
acceptance 
rate? 



# of applicants Could outreach be made more effec- 
• (From RSA-101) tive? 

rf Go to _ ji t i t g 



R-300 item, 
(06 takes too . 
long) ^ 

% 02 « > 06 
(too many enter 
06J_ 



What kinds of clients are going 
into 06? 

What kinds of services are provided 
during 06? 



Too High 



Dq. we, have 
too' many 
ineligi&le 
applicants? 



02 a > 08 and 
06 * > 08 



Too High 



Agency has* 
both an in- 
take and a 
timeliness 
problem 



Same as 2 and 3 



A- 



What reasons are given for closing 
clients ineligible? 

From where are these clients being 
referred? 



'Same as 2/ and 3 



See |2T23 ~«nd 
|2.2.3| . . 
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DISPLAY 2.2.0 



PRIMARY PROBLEM: EXPENDITURES PER REHABILITATION ARE.TOQ. 

(REFER TO* TABLE 2(ii)) 




TEST: (FIRST LEVEL INDICATORS) 

A. TOTAL "EXPENDITURES 
# CLOSURES (26.-30) 

(VALUE) XXXX 

(NORM) XXXX 

TOO HIGH? YES 

NO 



B. TOTAL EXPENDITURES 
# CASES (-ljO-30) 

(VALUE) XXXX 

(NORM) XXXX • 

TOO HIGH? YES 

NO 



IF NO TO BOTH A. AND B., GO TO DISPLAY 2.2.1 ;. 

IF YES TO A. AND NO, TO B., GO TO DISPLAY 2.2.2 

IF NO TO A. AND YES TO B., GO TO DISPLAY 2.2.3 

IF YES* TO BOTH A. AND B., GO TO DISPLAY 2.2.2. AND 2.2.3 

v 
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DISPLAY 2.2.1 

SECONDARY PROBLEM: EXPENDITURES PER REHABILITATION ARE TOO HIGH. EXPEN- 
DITURES PER CLOSURE AND. PER CASE ARE ACCEPTABLE. 

TEST: (SECOND LEVEL INDICATORS) 

CHECK IF AGENCY IS ACHIEVING A PROPORTION OF 26 CLOSURES THAT IS TOO LOW 

■ ! 26 - 

26+28*30 
(VALUE) XXXX 

(NORM) XXXX N 
TOO LOW? YES 
NO 

' / 

IF YES, GO TO DISPLAY 3.1.0 

IF NO, CONDUCT EVALUATION TO ANALYZE WHICH CLIENTS OR SERVICE COMPONENTS - 
ACCOUNT FOR THE HIGH COST (SEE DISPLAY 10.1.0). 



d 
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4 

DISPLAY 2.2.2 

• / • • . ' " 

SECONDARY PROBLEM: EXPENDITURES PER REHABILITATION AND PER CLOSURE ARE TOO 
. HIGH. EXPENDITURES PER CASE ARE ACCEPTABLE. ' 



TEST: (SECOND LEVEL INDICATORS) 

CHECK 'IF THE AGENCY IS ACHIEVING TOO FEW CLOSURES, OR IF THERE WAS 
, A LARGE NUMBER OF NEW CLIENTS LAST YEAR 

POST-CLOSURE ACCEPTANCE RATE: 

# 26+28+30 

# OPEN CASES 

CVALUE) XXXX i 
(NORM) XXXX 
TOO LOW? YES 
NO 



IF YES, SERVICE PROCESS IS TOO SLOW; GO TO 10.2s0. 



IF NO, TEST FOR # OPEN CASES 
. (VALUE) XXXX 




(NORM) XXXX 
TOO HIGH? YES 
NO 

IF YES, THE RECENT CLIENT INFLUX EXPLAINS LOW RATES VALUE. 
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DISPLAY 2.2.3 



SECONDARY PROBLEM: EXPENDITURES PER REHABILITATION ^ND PER CASE ARE TOO 

HIGH. EXPENDITURES PER CLOSURE ARE ACCEPTABLE. 



TEST: (SECOND LEVEL INDICATORS) 



/ 



CHECK IF THE AGENCY HAS RECENTLY DEVELOPED A BOTTLENECK AT INTAKE, 
SO THAT TOO FEW CLIENTS ARE BEING ACCEPTED. 



TEST: f APPLICATION RATE 

# SERVED 

100,000 POPULATION 

(VALUE) XXXX ' 
(NORM) XXXX 
' TOO LOW? YES 

NO . 

IF YES, GO TO DISPLAY l.'l.O. CHECK IF OUTREACH" MEASURES COULD BE MADE 
MORE EFFECTIVE. 

CHECK RATE OF ACCEPTANCE 

. # NEW STATUS 10s 
CASELOAD 

(VALUE) XXXX 

(NORM) XXXX 

TOO LOW? YES - * 

NO . 

IF YES, ANALYZE: # APPLICANTS: TOO FEW? 

02s X 06s: TOO MANY IN EXTENDED EVALUATION? . 
02s X 08s:. TOO MANY INELIGIBLE APPLICANT^/ - : --■ 
06s X 08s: TOO MANY INELIGIBLE APPLICANTS? 
. (SEE DISPLAY 10.1,0) . 



— Table 2(iiJ) and/or 2(iy) 
Standard Two; D*ta-BXc«ents- Three and/or Four 
Problem: 11ie Ratio of Benefits to Costs (B/C) or the Net Benefit (B-C) or Both Are Too Low 





First Level Indicators 


Second 


Level 


Indicators 


Scenario 


rxpendit'urcs/ 
Rehab i 1 i tat ion 


Implication 






I 

< 


Acceptable 


The costs do not appear out of 
line. The type of rehabilitation 
the agency is producing is not 
producing high-payoff return 
to society. 


Is % rehabilitations 
closed competitively 
too low? 


Yes 
No 


Go to |5.l.0| 

Are salaries too low? 
Go to |4.1.0| 


2 


Too high 


Go to |2,2.0| 










♦ 

l 











/ 
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DISPLAY 2.3.0 AND 2.4.0 

PRIMARY PROBLEM: THE RATIO OF BENEFITS TO COSTS' OR THE NET BENEFIT, OR BOTH, 
s ARE TOO LOW. 

(REFER TO TABLE 2(iii) AND/OR 2(iv)) 



TEST: (FIRST LEVEL INDICATOR) 
TOTAL EXPENDITURES/* 26 
(VALUE) XXXX 
(NORM) XXXX 
ACCEPTABLE? YES 
NO 

v 

IF YES, THE COSTS ARE NOT OUT OF LINE; THE TYPE OF REHABILITATION IS NOT 
PRODUCING A HIGH PAYOFF RETURN TO SOCIETY. i 

IF NO, GO TO DISPLAY 2.2.0. 
TEST: (SECOND' LEVEL INDICATOR) 

» 

# 26 COMPETITIVELY EMPLOYED/* 26 
(VALUE) XXXX 
(NORM) XXX 
TOO LOW? YES 

* 

NO 



IF YES, GO TO DISPLAY 5.1.0. L 

IF NO, GO TO DISPLAY 4.1.0. ^ ^/ 
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Table 

Standard Three, Data Element One 
Problem: Percentage of Rehabilitations Is Too Low 



J 

Scenario 


First level indicators 


Second Level Indicators"^ 


» 26s r 


\ in > 

Competitive 

Employment 


{ 

Implications 


t 

Implications 



Acceptable Acceptable 



Low % rehabilitants does not. mean there is a problem. The acceptable levels of 
rehabilitation and % competitively employed suggest that possibly*the performance 
level for this element is se£ too high* 



Acceptable Too low 



Agency has a high' percentage of 
noncompetitive placements 

Go to [S.1.01 for actions to in- 
crease number and % of compet i- 
tive placements/ See p .f . 11 



Too 4ow 



Tpo low 



Too low 



Overall rehabilitation level is 
too low. 



Is expend i- 
ture/rebabili- 
tation too 
high? 



See ffXl) 



Yes: Investigate ways to ;n- , 
crease servic e efficiency. 
Go to [2.2.01 

No; Analyze non-successful 
clients in terms of client char- 
acteristics, services received,* 
etc. Go to flO. 1. 01 



Acceptable Agency priority is on competitive 
employment, and fewer clients are 
served. 



Is e*xpendi- Yes: Investigate ways to "in-' 
ture/competi- crease service efficiency, 
tive 26 too Go to (2,2.0| ' j 



high? 
See 13,1,3) ' 



No: Analyze non-successfuls* 
in terra* of client characteristic 
and sendees received. " f 



Go to iio.uq 
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DISPLAY 3.1.0 



**1 



PRIMARY.'PROBLEM: PERCENTAGE OF REHABILITATIONS (% 26) IS TOO LOW/' j 
(REFER TO TABLE e3(i))« 

• . . '. , : ■ f 

TEST:. (FIRST LEVEL INDICATORS) 

•- • I 

EXAMINE THE TOTAL NUMBER OF REHABILITATIONS (#26) AND, OF THOSE', 

* " THE PERCENTAGE PLACED IN COMPETITIVE EMPLOYMENT (% CtE) 

\ 

. # 26 COMPETITIVELY EMPLOYED/J^2^ 
(VALUE) XXXX 




^# 26s 
g (VALUE) XXXX 
(NORM) XXXX 



(NORM) XXXX. 



V 



A. ' ACCEPTABLE LEVEIrf 




YES 
NO 



B. ACCEPTABLE LEVEL? 



YES 

K\ ■ 



IF -YES TO A. AND B. , NO PROBLEM IS INDICATED, SINCE % COMPETITIVELY 
EMPLOYED IS A MORE POWERFUL MEASURE. 

IF -YES TO A. AND NO TO B., J30 TO DISPLAY 3.1.1. 

IF NO TO A. AND B., GO TO DISPLAY 3.1.2. 

IF NO TO A. AND YES TQ_ B . , GO TO DISPLAY 3.1.3. 
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DISPLAY 3.1.1 



SECONDARY PROBLEM: PERCENTAGE OF REHABILITATIONS IS TOO LOW, AND SO IS 

THE PERCENTAGE OF COMPETITIVELY CLOSED 26s . HOWEVER, 
THE OVERALL NUMBER OF REHABILITATIONS IS AT AN 
ACCEPTABLE LEVEL. 



THIS CONDITION .IMPLIES THAT THE AGENCY HAS A HIGH PERCENTAGE OF NON-COMPETITIVE 
PLACEMENTS. •' * 



INCREASE NUMBER AND % OF COMPETITIVE PLACEMENTS. • GO TO DISPLAY 5.1.0. 
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DISPLAY 3.1.2 



SECONDARY PROBLEM: THE NUMBER AND 'PERCENTAGE OF REHABILITATIONS IS TOO LOW, 

AS IS - THE - PERCENTAGE OF REHABILITANTS CLOSED COMPETITIVELY. 
THIS AGENCY'S OVERALL REHABILITATION RATE IS TOO LOW 

TEST: (SECOND LEVEL INDICATORS) " • ' 

CHECK IF COST/ REHAB 1 L ITAT ION IS TOO HIGH 
> TOTAL EXPENDITURES/ # 26 
(VALUE)' XXXX 
(NORM) XXXX 
TOO HIGH? YES 
NO 

IF YES, INVESTIGATE WAYS TO INCREASE SERVICE EFFICIENCY. GO TO DISPLAY 2. .2.0. 

IF NO, ANALYZE NONSUCCESSFUL CLIENTS IN TERMS OF CLIENT CHARACTERISTICS, 
SERVICES RECEIVED, ETC. "GO TO DISPLAY 10.1.0. , 



^1 
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DISPLAY 3.1.3 



SECONDARY PROBLEM: THE NUMBER AND PERCENTAGE OF REHABILITATIONS ARE BOTH 



TOO LOW; HOWEVER, THE PERCENTAGE OF REHAB ILITANTS 
COMPETITIVELY EMPLOYED IS ACCEPTABLE. AGENCY PRIORITY 
IS ON COMPETITIVE EMPLOYMENT AND FEWER CLIENTS ARE 
SERVED. 



TEST: (SECOND LEVEL INDICATORS) 

CHECK IF COST/COMPETITIVE 26 IS TOO HIGH. 
TOTAL EXPENDITURES/* 26 COMPETITIVELY EMPLOYED 
"(VALUE) XXXX 

(NORM) XXXX " 
TOO HIGH? YES 



IF YES, INVESTIGATE WAYS TO INCREASE SERVICE EFFICIENCY. GO TO DISPLAY .2.2.0. 

IF NO, ANALYZE NONSUCCESSFUL CLIENTS IN TERMS OF CLIENT CHARACTERISTICS, 
SERVICES RECEIVED, ETC. GO TO DISPLAY 10.1:0. 



NO 
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i Table 3(ii) 

Standard Three'; Data Element Two 
Problem; There Is a Problem In the Annual Gunge ^Rehabilitations 







First Level Indicators 




— 6 > 1 

Number 






of 26 


• 




Closures in 




Scenario 


Current Year 


Implications 


. 1 


Too. low 


Agency -closure problem is confirmed by this data 
element, 



go to (org 



Adequate • Agency production, whilt still adequate, shows 

decline. Examine current caseload- size to deter* 
t mine if {iccline is temporary* If not, increase 
acceptances. 

go to frx3 



/ 
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DISPLAY 3.2.0 

PRIMARY PrHl1m7~THE ANNUAL CHANGE IN REHABILITATIONS IS NOT ADEQUATE. 
(REFER TO TABLE 3(ii)) . 

TEST: *(FIRST LEVEL INDICATOR) 
NUMBER OF 26 CLOSURES 
(VALUE) XXXX 
(NORM) XXXX 

. ACCEPTABLE? YES •• . 

NO , 

* 

IF NO, GO TO DISPLAY 3.1.0. 
IF YES, GO TO DISPLAY 1.1.2. 
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Element Two 



Table 4(i) and 5(ii) 
Standard Four, Data Element One and Standard Five, ti 

Problem: V 26s Eamfng Weekly Minima Wage is Too low and/or 
I Competitively Employed 26s Earning Hourly Minimum Wage is Tbo low 







Scenario 




First level 


Indicators 


' f 1 

Second Level Indicators 


^ C-E * 26s 
with hourly 
earnings 
above mini- 
mum wage 
(Sii) 


1 C-E* 26s 
ff 26s ♦ 


Implicatibns 


Leading Questions 


Actions 



1 Acceptable Acceptable 



See FTTH 



The agency generates - 
enough c-e closures, and 
those closures earn ade- 
quate hourly wages. Lpw 
weekly wages may result 
from too many part-time 
(PT) closure occupations. 
Check on hours worked by 
rehabi litants . 



Do PT workers de- 
sire PT work? 
_(casje_review) 

Do placement 
strategies reflect 
the client's em- 
ployment goals7 



If not, review placement policy; con- 
sider possibility of 'encouraging cli- 
jsntaf to j,o_ for fullHtipo_ ea^l o/«ertt_ 

Go to |S. 1.1| 

Replace "C-E/N-C-E" with "FT/PT" 
Determine if your lack of FT closures 
is due to: inadequate placement, . 
inadequate and/or inappropriate 
services, or client" difficulty 



Acceptable Too low 



See (4m 



The agency generates Do the job goals Go to |4.2.2| 

enough c-e closures, but for c-e closures 

their hourly earnings aim for sufficient Include analysis of job market vis-a- 

are low. Regardless of _earnin£S?_ vis earnings levels 

* of hours worked, . 9 t a 

agency needs to improve * re the -> ob 8 oals Co t0 P>1*1| 

hourly earnings, feasible? Replace "C-E/N-C-E" with "earns weekly 

m minimum wage/doesn't earn weekly 

/ minimum wage" 



Agency may also have too 
many PT closures 



Tp scenario 1 
above 



Go to pTTTT| 



■Too low 



Acceptable 

EZE3 



See 



The agency generates too 
few c-e closures, thus 
reducing earnings for 
all 26»s 



Does the agency 
generate enough 
competitive em- 
ployment plans? 



Go to p.l.Ol 



Too low 



Too low 



See fTTT4) 



The agency has two prob- 
lems ; It generates an 
insufficient * of c-e 
closures * 



Go to s cenario 3, 
above, BTO] 



AND- 



Its c-e closures earn 
insufficient hourly 
wages 



Go to s cenario 2, 
above, [4,1. 2| 



er|c 



C-E 3 coupe-Chive employment 
N-C-E ■ non-c<Jmpeti*ive employment 
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A-44 



DISPLAY 4.1.0 



PRIMARY PROBLEM: % 26s 1RRRIN5~WEEKLY MINIMUM WAGE IS. TOO LOW. 

(REFER TO TABLE 4(i)/5(ii)) 



TEST: (FIRST LEVEL INDICATORS) 

A. % COMPETITIVE 26s WITH 
HOURLY EARNINGS ABOVE 
MINIMUM WAGE 

(VALUE) XXXX 

(NORM) XXXX 

TOO LOW? YES 

NO 



B. % 26s COMPETITIVELY EMPLOYED 
# 26 



(VALUE) XXXX 
(NORM) XXXX 
TOO. LOW? YES 
NO 



IF NO TO A.' AND B., GO TO DISPLAY 4.1.1. 

IF YES TO A. AND NO TO .B., GO TO'DISPLAY 4.1.2. ' - 

IF NO TO.A. AND YES TO B., GO TO DISPLAY 4.1.3. 

IF' YES TO- A. AND B., GO TO DISPLAY 4.1.2 and 4.1,3. THIS' AGENCY HAS TWO 
PROBLEMS: IT, GENERATES AN INSUFFICIENT NUMBER OF C-E CLOSURES AND ITS 
C-E CLOSURES EARN INSUFFICIENT HOURLY WAGES. 



# 26 C-E* EARNING AT LEAST THE HOURLY MINIMUM WAGE 
# 26 COMPETITIVELY EMPLOYED,- • ~ 
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*C-E » COMPETITIVELY EMPLOYED 



■-(■■;< 



V 

DISPLAY 4.1.1 '• 



SECONDARY PROBLEM: % 26s EARNING WEEKLY MINIMUM WAGE IS TOO LOW, BUT 

BOTH THE % OF COMPETITIVELY "EMPLOYED REHABILITANTS 
EARNING THE MINIMUM WAGE AND THE % OF COMPETITIVELY 
EMPLOYED REHABILITANTS ARE" ACCEPTABLE. 

TEST: (SECOND LEVEL INDICATORS) •« -r ' , '* 

CHECK IF THE LOW WEEKLY VgES ARE EXPLAINED J$Y TOO MANY PART-TIME 
CLOSURE OCCUPATIONS 

♦ 

AVERAGE HOURS WORKED/WEEK: XX 
FULL-TIME HOURS/WEEK: . 40- 

IF AVERAGE IS LOW, DO CASE REVIEW TO DETERMINE IF FULL-TIME WORK W^S CLIENT'S 
GOAL. DO PLACEMENT STRATEGIES REFLECT THE CLIENT'S EMPLOYMENT GOALS? 

YES . ' ^ 

NO 

"J 

IF NO, REVIEW' PLACEMENT POLICY — CONSIDER POSSIBILITY OF ENCOURAGING CLIENTS 
TO GO FOR FULL-TIME EMPLOYMENT. GO TO DISPLAY 5.1.1 AND REPLACE "C-E/N-C-E"* 
WITH FT/PT**. 



*C-E » COMPETITIVE EMPLOYMENT 
N-C|E =• NONCOMPETITIVE EMPLOYMENT \ 

' ' 4 'i 

jfF.r .FULL-TIME EMPLOYMENT ( 1 - 50 

PT PART-TIME EMPLOYMENT 



A-^6 



SECONDARY PROBLEM: 



DISPLAY 4.1.2 

% 26s EARNING WEEKLY MINIMUM WAGE IS TOO LOW, AS IS THE 
% COMPETITIVELY EMPLOYED 26s WITH HOURLY EARNINGS ABOVE 
THE MINIMUM WAGE. ' HOWEVER, THE % OF REHABILITANTS 
COMPETITIVELY EMPLOYED IS ACCEPTABLE. 



TEST: (SECOND LEVEL INDICATORS) ' ' ' 

- • CHECK IF HOURLY EARNINGS ARE TOO LOW 
(VALUE) XXXX -* 

(NORM) XXXX ' " . 

TOO LOW?" YES 

NO ♦ 

IE YES, AND IF CASE REVIEW INDICATES THAT THE JOB GOALS FOR COMPEWrtVEL^ 
EMPLOYED CLOSURES AIM FOR SUFFICIENT WAGES, GO TO DISPLAY 4.2.2 AND INCLUDE 
ANALYSIS OF THE JOB. MARKET VIS-A-VIS EARNINGS LEVELS. 



CHECK IF CLIENT JOB GOALS ARE IN DEMAND. (JOB MARKET REVIEW) 

SO TO DISPLAY 5.1.1 BUT REPLACE "C-E/N-C-E 11 * "WITH "EARNS WEEKLY MINIMUM WAGE/ 
ESN'T EARN WEEKLY MINIMUM WAGE." ■ 



CHECK IF THERE ARE TOO MANY PART-TIME CLOSURES. 
(VALUE) XXXX 

(NORM) XXXX % ... 
TOO MANY? YES - 
NO ' 

IF YES, GO TO DISPLAY 4.1.1.- 



ERIC 



/ 



*C-E »JC0MPETITIVELY -EMPLOYED 
N-C-Ef* NON-COMPETITIVELY. EMPLOYED 
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A-47 
DISPLAY 4.1.3 



SECONDARY PROBLEM: % 26s EARNING THE WEEKLY MINIMUM *WAGE IS TOO LOW/ THE 

% 26s COMPETITIVELY EMPLOYED IS TOO LOW, BUT THE % 
COMPETITIVELY EMPLOYED 26s WITH HOURLY EARNINGS ABQVE 
THE MINIMUM WAGE IS ACCEPTABLE. THIS AGENCY GENERATES, 
TOO" FEW C-E*CLOSURES, THUS REDUCING EARNINGS FOR ALL 26s. 



TEST: ^(SECOND LEVEL INDICATORS) • 

CHECK IF THE AGENCY GENERATES ENOUGH COMPETITIVE EMPLOYMENT PLANS. 

„ *~ f G-E*"PLANS IN YEAR 
TOTAL PLANS IN YEAR 

(VALUE) XXXX 

(NORM) XXXX 

ADEQUATE? YES 

. NO 



IF NO, GO TO DISPLAY 5.1.0. 
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DISPLAY 4.1.4 



SECONDARY PROBLEM: % 2,6s EARNING WEEKLY MINIMUM WAGE IS TOO LOW, THE % 

OF COMPETITIVELY, EMPLOYED REHABILITANTS WITH HOURLY 
EARNINGS ABOVE MINIMUM "WAGE IS TOO LOW, AND THE % OF 
COMPETITIVELY EMPLOYED 26s IS TOO LOW FOR THE AGENCY.. 



GO TO DISPLAYS 411.2 and 4.1.3. 




Table 4(ii) 
Standard t^ur, Data Element Two 
Problem; Average Earn ings of Competitively Employed Rehabil'itants Are Too Low 
When Compared to Average Earnings of Employees in State 



ERIC 



Scenario 


First level Indicators 




, Second Level Indicators 


• 

* Third Level Indicators i 


Compare Median Income of 
Competitively Employed 
26s to the Median Income 
of Employees in- the 
State 




Leading % 

Questions 


< 

Implications 




Leading 

Questions 


Implications , j 



of the med* 
ian income 
to the mean 
income of 
competi- 
tively em- 
ployed 26 
closures 



come is 
less than 
mean income 



well, it is because there are 
>many closures in low paying 
„jobs. 

Co to glO 



Median in- 
come is 
greater 
than or 
equal to 
mean 



The problem does* appear to be 
be ^artificially caused by the 
method of measurement. ' 



See |4.2.1) 



Too low 



DOT codes 
of the job 
goals of 
competi- 
tively em- 
ployed 26 
closures 



Were cli- 
ents 1 job 
goals in 
suffi- 
ciently 
high paying 
occupa- 
tions?* 

Yes 



Although job goals are' in 
fields that pay well in com- 
parison to employees in the 
state, closures are not 
realizing these earnings. 

See fOT^ 



DOT codes 
x>f job 1 
• 'goals and 
DOT codes 
of jobs 
obtained 
at closure 



Is the 
closure DOT 
code great- 
er than or 
equal to 
the DOT 
code of the 
job goal? 

Yes 



No 



> ft 




\ 



No 
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Clients are not being prepar~ None 
$d for jt>bs that 4>ay^ we'll in 
comparison to other employees 
in the state. Examine the types' 
of services you provide. You « 
should be providing services 
that will result in higher* 
paying jobs at closure. ' 



None 



You are providing services 
for and are making placements' 
in acceptable pay job cate- 
gories.' But your closures 
are earning less than their 
counterparts in the state. 
Is there something about your 
service program that could be 
improved to better prepare 
clients and increase their 
earnijv^ _otential?_ ______ 

Clients are getting lowep, 
paying jobs than what tney 
originally aspired to. 

• Examine your placement ef- 
fort. With additional 
placement assistance, could 
your clients obtain better 
paying jobs? v 

• Do the Job goals of clients 
exist in your state? If 
they donU — clients 
should have goals that are 
also in sufficiently high 

J_y_ng, jobs_ _______ 

None ' 



55 



> 



A-SO 



ERIC- 
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DISPL'AY 4.2.0 



PRIMARY PROBLEM: AVERAGE EARNINGS OF COMPETTJIVELY EMPLOYED REHAB I L HANTS 

ARE TOO LOW WHEN COMPARED TO AVERAGE EARNINGS OF EMPLOYEES 
IN STATE (REFER TO TABLE 4(ii)) 



TEST: (SECOND-LEVEL INDICATORS) 

MEDIAN INCOME OF COMPETITIVELY EMPLOYED 26s 
MEDIAN INCOME OF EMPLOYEES IN THE STATE 

(VALUE) XXXX 

(NORM) XXXX 

ACCEPTABLE RATIO? YES 

NO 

IF YES: GO TO DISPLAY 4.2.1 
IF NO: GO TO DISPLAY 4.2.2 



$6 



-rr- 
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■ I 

DISPLAY 4.2.1 

SECONDARY PROBLEM: THE AVERAGE EARNINGS OF COMPETITIVELY EMPLOYED RE- 
HABILITATES IS TOO LOW WHEN COMPARED TO .AVERAGE 
EARNINGS OF EMPLOYEES IN THE STATE. HOWEVER-, THE 
RELATIONSHIP OF MEDIAN EARNINGS' FOR THE TWO GROUPS 
IS ACCEPTABLE. -- • 



'TEST: (SECOND-LEYEL INDICATORS) 

IDENTIFY THE RELATIONSHIP BETWEEN THE MEDIAN AND MEAN INCOME 
VALUES FOR COMPETITIVELY EMPLOYED 26s 

(MEDIAN) XXXX . 

(MEAN) XXXX 



IF THE MEAN IS GREATER, GO TO DISPLAY 4.2.2 - 

IF THE MEDIAN IS GREATER, THE PROBLEM FLAGGED BY THE DATA ELEMENTS 
APPEARS TO BE ARTIFICIALLY CAUSED BY THE SELECTION OF THE MEAN AS 
THE MEASURE OF CENTRAL TENDENCY. 
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.DISPLAY 4.2.2 * 



SECONDARY PROBLEM: BOTH THE AVERAGE AND MEDIAN ..EARNINGS OF COMPETITIVELY 

EMPLOYED REHABILITANTS ARE TOO LOW WHEN COMPARED TO 
THE AVERAGE AND MEDIAN EARNINGS, RESPECTIVELY, OF 
EMPLOYEES IN THE STATE 



TEST: ( SECOND - LEVEL*"IND I CATORS ). 

USE D.O.T. CODES OF THE JOB GOALS OF COMPETITIVELY EMPLOYED 26s 
TO EXAMINE IF CLIENT JOB GOALS ARE IN SUFFICIENTLY HIGH-PAYING 
OCCUPATIONS 

YES 

NO 



IF YES, CLIENTS ARE NOT ACHIEVING THE LEVEL OF CLOSURE PLANNED AS A GOAL. 
COMPARE D.O.T. CODES OF GOALS TO PLAN TO DETERMINE WHETHER: 

A. PLACEMENT FITS GOAL, BUT CLIENT'S SALARY IS LOWER 
THAN PLACEMENT WOULD SUGGEST 

B. PLACEMENTS ARE IN LOWER PAYING JOBS THAN PLANNED 

IF NO, EXAMINE YOUR GOAL-PLANNING PROCESSES. ATTEMPT TO DETERMINE THE' 
REASONS WHY .COUNSELORS PLAN FOR LOW-PAYING JOBS. POSSIBLE REASONS , 

INCLUDE: 

• THE SERVICES NEEDED TO GET CLIENTS-1NTO HIGHER-PAYING 
JOBS ARE LACKING; 

COUNSELORS ARE UNAWARE OF AVAILABLE HIGHER-PAYING JOBS; 

COUNSELORS ARE UNAWARE OF THE AGENCY'S GOALS FOR CLOSURE 
WAGES. 




J 
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TabU 5(1), 
Standard Five, Pat* Element One' 
Problem: Percentage of Competitively Employed Rehabilitants Is Too low 

5 







First Level 


Indicators 


Second Level 


Indicators 


Third Level 


Indicators 


Scenario 


€-E* Coal/ 
Occupation 
Correspon- 
dence 


% N-C-E" 
Plans 


Implications 






Implications 






Implications 


1 


Low 


High 


Staff planned for 
but failed to 
achieve sufficient 


Investigate 
reasons for 
emphasis on 










\ 



Current planning is 
for too few C-E 
plans. 



Acceptable High 



7 



N-C-e plans. 
May wish to - 
intervene with 
current case- 
load, or use 
results of 
investigation 
to change fu- 
ture field 
practices . 



see grim 



Plains fop too many 
N-C-E closures both 
in the past and 
currently. . 



No 



Check rehabil- Yes 
itation rate — * — 
for agency: 

I 26 

All cases 
Tdo low? 



Go to ETTol 



Check appropriateness 
of N-C-E plans and 
closures for closure 



See O3 8r0UP ' 



Acceptable • Acceptable 



J 



There were plans for 
too many N-C-E 
closures for tbis 
year's rehabili- 
tants, but this 
year l 3 planning 
seems to have cor- 
rected this. 



Monitor* cur- 
rent caseload. 
Are» there suf- 
ficient C-E 
clients 
the current 
period? 



Yes 



No current problem 



No Check appropriateness 

of current N-C-E 
plans. 



See TS. 1.3| 



Low 



Acceptable 



Staff planned for 
but failed to 
achieve sufficient 
C-E. closures. Cur- 
rent planning for 
sufficient C-E. \ 



Does goal Yes 
planning real- ' 
istically re- 
flect labor 
market? 



Are placement Yes 
efforts ade- 
quate? 



Perform comparison 
analysis on C-E and 
N-C-E clients to 
identify patterns in 
clients or services. 



> 
I 



No 



Improve placement 
effort 



See [sTiT3[ 



No Disseminate informa- 

tion to the field op 
labor market demand. 
Monitor ongoing goal 
setting, and direct 
counselors to set 
goals reflective of 
that demand. 



Ir-Q I wC-E * Competitive Employment 

1 C I\l v> 'N-C-E « Noncompetitive Employment 
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DISPLAY 5.1.0 




PRIMARY PROBLEM: PERCENTAGE OF COMPETITIVELY EMPLOYED REHABILITANTS IS TOO 
LOW. 



(REFER TO TABLE 5(i)) 



TEST: (FIRST LEVEL INDICATORS) 

A. . C-E* GOAL-OCCUPATION 
CORRESPONDENCE 

(VALUE) XXXX 
(NORM) XXXX 
ACCEPTABLE? YES 
NO 



m 



B. % N-C-E*: PLANS IN YEAR 
TOTAL PLANS IN YEAR 

(VALUE) XXXX 

(NORM) XXXX ' 

ACCEPTABLE? YES 

NO 



IF NO TO A. AND B., GO TO DISPLAY 5.1.1. 

IF YES TO A. AND NO TO B., GO TO DISPLAY 5.1.2. 

IF YES TO A. AND B., GO TO DISPLAY 5.1.5. . 

IF NO TO A. AND YES TO' B., GO TO DISPLAY 5.1.4. 
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*C-E » COMPETITIVE EMPLOYMENT 
N-C-E » NON-COMPETITIVE EMPLOYMENT 



ERIC 
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DISPLAY 5;1.1; 

' SECONDARY PROBLEM: PERCENTAGE OF COMPETITIVELY EMPLOYED REHABILITANTS .IS 

L TOO LOW. C-E* GOAL/OCCUPATION CORRESPONDENCE RATIO -IS, 
TOO LOW AND % N-C-E/ PLANS IS TOO HIGH. 

• . ' ' '>'/ • 



CURRENT PLANNING IS FOR TOO FEW C-E PLANS. INVESTIGATE REASONS F° R EMPHASIS 
ON N-C-E PLANS. 

CHECK APPROPRIATENESS OF N-C-E PLANS AND CLOSURES. 



r 



*C-E »■ COMPETITiVE EMPLOYMENT - 82 

N-C-E" » NON-COMPETITIVE EMPLOYMENT 



. DISPLAY- S.1.2 ; 

' • ; • ' i i 



SECONDARY PROBLEM: PERCENTAGE OF COMPETITIVELY EMPLOYED REHABILITANTS. IS 
„ '• . TOO LOW.- C-E* GOAL/OCCUPATION CORRESPONDENCE IS ACCEPTABLE 

. . ' :" f5UT %- N-C-E * • PLANS IS TOO HIGH. . 



TEST: (SECOND; LEVEL INDICATORS): 



■J 



REHABILITATION RATE ' 

i ' - . .' ' ' 

g 26s • ; ' 



ALL CASES 
(VALUE) XXXX 
(NORM) ' XXXX' 
TOO LOW? YES 
•NO. 



IF YES, GO TO DISPLAY 3.1.0. 

IF^O, CHECK APPROPRIATENESS OF N-C-E PLANS. 
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C-E » COMPETITIVE EMPLOYMENT 
N-C-E a NON-COMPETITIVE EMPLOYMENT 
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ERIC 



DISPLAY S.1.3 



SECONDARY PROBLEM: PERCENTAGE OF" COMPETITIVELY EMPLOYED REHABILITANTS IS 

TOO LOW BUT C-E* GOAL/OCCUPATION CORRESPONDENCE AND % 
N-C-E* PLANS ARE ACCEPTABLE. 



MONITOR CURRENT CASELOAD TO TEST IF THERE ARE SUFFICIENT C-E CLIENTS FOR 
THE CURRENT PERIOD. 

IF NOT, CHECK APPROPRIATENESS OF CURRENT N-C-E PLANS. 



1 /*V*;. 



1 
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*C-E * COMPETITIVE EMPLOYMENT , • 
N-C-E = %)N-COMPETITIVE EMPLOYMENT ' / 



\ 



a V, 



A-58- 



DISPLAY S.1.4 



SECONDARY PROBLEM: PERCENTAGE OF COMPETITIVELY EMPLOYED REHABILITANTS IS 

TOO LOW. C-E* GOAL/OCCUPATION CORRESPONDENCE IS TOO LOW 
BUT- % N-C-E* PLANS IS ACCEPTABLE. 



QUERY: DOES GOAL PLANNING .REALISTICALLY REFLECT LABOR MARKET? 



IF NO, MONITOR ONGOING GOAL-SETTING, INSTRUCT&G COUNSELORS TO SET GOALS 
REFLECTIVE OF LABOR MARKET DEMAND. * 

IF YES, CHECK IF PLACEMENT EFFORTS WlE ADEQUATE . 



\ 




*C-E' = COMPETITIVE EMPLOYMENT . • 
N-C-E » NON-COMPETITIVE EMPLOYMENT 
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Table 6(i) 
Standard Six, Data Element One 
Problem: Client Earning Gain is Insufficient 





First Level Indicators 


Scenario 


Percent 26s 
Earning . 
Minimis Wage 
4(i) 


Implications 


1 


Acceptable 


Exai|ij)e_eJ_UiMIity_po|icy. and , acccptance-practi ce>~ 
as program does not appear to demonstrate economic 
return on investment. ' 




See fe.l.Ol 


2 


Too low 


Earnings at closure are too ^ow. 
Go tol4.1.0| 
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DISPLAY 6.1.0 

PRIMARY PROBLEM: CLIENT. EARNING GAIN 'IS INSUFFICIENT,. 
(REFER TO TABLE 6(i)) 



TEST: (FIRST LEVEL INDICATOR) 

r 26s EARNING MINIMUM WAGE 
#~~26s 

(VALUE) XXXX . 
(NORM) XXXX 
ACCEPTABLE? YES 

NO v 



IF YES, EXAMINE ELIGIBILITY POLICY AND ACCEPTANCE PRACTICE. 
IF NO, GO TO DISPLAY 4.1.0. 



67 



V 



Table 7(i) 

^ / Standard Seven, Data Element Onm 

Problem: There ij a High Percent of Clients Emo loyedTT Closure Who Have Not Retained Their Earnings at Follow „ r 



Scenario 



1 

J 



Some of the 26 placements may 
be invalid. Examine closure 
and placement policy* 
Examine (ilans. , Are place* 
ments appropriate? 



First le vel Indicators 

j Implications" 



Yes Examine industry conditions, 
other explanatory factors 
(employment rate, health, 
etc.) 

Go to fTIT^ 



See 7.1.0 



No Revise agency plan and 
placement policies. 



Does the agency serve types Yes 

of clients, who systemati- 

cally fail to retain, jobs? No 
(See 10.1.0) « 



Examine accep 



ep^anc£ procedures 

Are .service plans adequate 
preparation for placements? 

Go to [4. 2.2) 



\ 



.ERIC 
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DISPLAY 7.1.0 - /. 

PRIMARY PROBLEM: A HIGH PERCENTAGE* OF CLIENTS EMPLOYED AT CLOSURE HAVE 
NOT RETAINED THEIR EARNINGS AT FOLLOW-UP 

(REFER TO TABLE 7(i)) 

TEST:, (FIRST LEVEL INDICATOR)- , 

EXAMINE CLOSURE AND PLACEMENT POLICY AND PLANS 
APPROPRIATE? YES 
NO 

IF YES, EXAMINE INDUSTRY CONDITIONS AND OTHER EXPLANATORY FACTORS. 
SEE DISPLAY "4.2.2, 

IF NO, REVISE AGENCY PLAN AND PLACEMENT POLICIES. 

TEST: CHECK IF AGENCY SERVES TYPES OF CLIENTS WHO- SYSTEMATICALLY FAIL 
TO RETAIN JOBS (SEE 10.1.0) 

IF YES, EXAMINE ACCEPTANCE PROCEDURES. 

IF NO, EXAMINE ADEQUACY OF SERVICE PLANS. SEE DISPLAY 4.2.2. 




y 
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GENERAL CLIENT AND 'SERVICE ANALYSES 
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DISPLAY 10.1.0 

PROBLEM: DISPLAYS INDICATE NEED. FOR ANALYSIS OF AGENCY CLIENT AND SERVICE 
PROBLEMS. DATA FILES ON VARIABLES SUCH AS**THE FOLLOWING SHOULD 
BE USED FOR STATISTICAL ANALYSIS OF SERVICES. 

CLIENT ANALYSIS VARIABLES LIST: 
COUNSELOR 

REGION OR AREA _ H 

STATUS: 02 . 

' 02-06 
08 

10-24 
26 

.- _ 28 

30* ' 

CLOSURE TYPE: C-E (COMPETITIVE. PLACEMENT*) 

N-C-E (NON-COMPETITIVE PLACEMENT.) 

SERVICE COSTS 
DISABILITY 
SEVERELY DISABLED 
EDUCATION 
WORK HISTORY 

REFERRAL SOURCE — 
SERVICES- RECEIVED 
• TIME IN STATUS 

EARNINGS AT CLOSURE 
' CHANGE IN EARNINGS 



ft 
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DISPLAY 10.2.0 *' 
(SEE FIGURE iQN NEXT PAGE). 



SELECT SAMPLE OF ACTIVE CASES. COMPARE TIMES IN -STATUS WITH AGENCY NORMS. 



r 



MONTHS 00-02 



(VALUE) XX 
0 . (NORM) XX 



MONTHS 02-10 

(VALUE) XX ' 
(NORM). XX 



MONTHS 02- 



, (VALUE) XX. 
. (NORM) XX 

4 



DO CASES EXCEED TIME IN PROCESS NORMS? NO . J 

\ 



YES. 



A « # CASES NOT EXCEEDING NORMS . 

, / • • 



IF YES, ARE THESE CASES, UNTIMELY ? (USE CASE REVIEW TO DETERMINE IF ^LAGGED 
CASES SHOW UNDUE DELAY.)' ' 



NO 



YES . 



B = # CASES' WITH EXCESS TIME IN PROCESS, BUT JUDGED 
' . AS TIMELY. 

C - # CASES WITH EXCESS TIME IN PROCESS AND JUDGED 
. UNTIMELY. 



FOR ALL CASES WITH EXCESS TIME IN PROCESS AND JUDGED UNTIMELY, INVESTIGATE , TO 
IDENTIFY CAUSES (E.G., TYPE OF CLIENT, PLAN, COUNSELOR, DISTRICT, EMPLOYMENT 
CONDITIONS, ETC.) * , , ■ '~ ' 



AND 
TEST: 



B 



B + C 



- 20%? 



YES 
NO 



J.' 



IF NO, INCREASE AGENCY TIME IN PROCESS .STANDARDS (FLAG FEWER CASES) BEFORE 
NEXT REVIEW' PERIOD . " * • 



TF^YES, TEST: Br * C £— S%? YES^ - \ " ■ • ' ' ' ' 

IF NO; NO ADJUSTMENT TO FLAGGING IS'NEEDED. ' ■ '.«' 

IF YES, DECREASE AGENCY TIME IN PROCESS STANDARDS (FLAG WORE CASES) BEFORE 

' ?-) '. • * - •' i -, 1 , 
NEXT REVIEW PERIOD. 1 

. - <L * 
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Model Case Flagging Systea 



Establish Tine in 
Process Standards 



7* 



Establish Tiaeiiness 
Assessment Procedures 
(Case Review) 



Increase Time Al 
in Status (Flag 
Fewer Cases) 



Analyze Case 
Service Process 



j Select Case 




no 



A » Count of all 
cases with no time 
in status problem 
flagged _ 



yes* 



Review Case 




no 



B » Count of all 
flagged cases judged 
as timely 



yes 



.C * count of all 
flagged cases that are 
judged untimely 




No Adjustment Needed I 



Oecrease Allowed Times 
in Status (Flag more 
Cases) 
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